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(54) METHOD AND DEVICE FOR PROCESSING SIGNAL 

(57)Abstract 

PROBLEM TO BE SOLVED: To selectively record a 
picture signal related to a picture accompanied with the 
change of feelings of a viewer or the like. 
SOLUTION: A CCD 8 and living body sensors such as a 
temperature sensor 111 are set to a human body. The 
CCD 8 converts incident image pickup light to a picture 
signal. The picture signal is supplied to a picture signal 
processing part 10 and a delay element 15 through an 
A/D converter 9. The picture signal processing part 1 0 
generates a trigger signal V related to the picture signal 
on the basis of the supplied signal. Meanwhile, signals 
generated by living body sensors 111 to 11 n are supplies 
to signal processing parts 131 to 13n through A/D 
converters in the succeeding stage. Signal processing 
parts 131 to 13n generate trigger signals related to 
signals of living body sensors on the basis of supplies 
signals. Each trigger signal is supplied to a recording 
control part 1 6. The recording control part 1 6 controls 
operations of a delay element 15, a record formatting 
circuit 17, and the recording control part 16 on the basis of respective trigger signals 
the picture signal on a magnetic disk 19. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 


CLAIMS 


[Clatm(s)] 

[Claim 1]A signal processor comprising: 

An image sensor which generates a picture signal. 

A biomedical signal sensor. 

A picture signal processing means to perform predetermined processing to a described image 
signal under conditions set up based on an output of a described image signal and the above- 
mentioned biomedical signal sensor. 

[Claim 2]A signal processor characterized by a described image sensor being a CCD sensor in 

claim 1. 

[Claim 3]A signal processor, wherein the above-mentioned biomedical signal sensor contains a 
temperature sensor in claim 1. 

[Claim 4]A signal processor, wherein the above-mentioned biomedical signal sensor contains a 
myoelectric potential sensor in claim 1. 

[Claim 5]A signal processor generating a picture signal where a human body is equipped with a 
described image sensor, and which starts a picture corresponding to a covering arrival person's 
view in claim 1. 

[Claim 6]A signal processor, wherein a human body is equipped with the above-mentioned 
biomedical signal sensor in claim 1. 

[Claim 7]A signal processor, wherein a described image signal processing means detects change 
of an output of a described image signal and the above-mentioned biomedical signal sensor and 
sets up the above-mentioned conditions in claim 1 based on a detection result. 
[Claim 8]A signal processor, wherein a described image signal processing means detects inter- 
frame difference from a described image signal and sets up the above-mentioned conditions in 
claim 1 based on a detection result. 

[Claim 9]A signal processor, wherein a described image signal processing means detects a 
described image signal lost-motion vector and sets up the above-mentioned conditions in claim 
1 based on a detection result. 

[Claim 10]A signal processor, wherein a described image signal processing means sets up the 
above-mentioned conditions in claim 1 based on the amount of information which calculated and 
calculated the amount of information of a described image signal. 

[Claim 11]A signal processor, wherein a described image signal processing means sets up the 
above-mentioned conditions in claim 1 based on a temporal change of the amount of information 
which calculated and calculated the amount of information of a described image signal. 
[Claim 12]A signal processor characterized by the above-mentioned conditions being the things 
concerning specification of a period that the above-mentioned predetermined processing is 
performed in claim 1. 

[Claim 13]A signal processor characterized by the above-mentioned conditions being what starts 
when starting the above-mentioned predetermined processing in claim 1. 
[Claim 14]A signal processor characterized by the above-mentioned predetermined processing 
being processing which records a described image signal in claim 1 . 
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[Claim 15]A signal processor having further the composition concerning processing which 
reproduces a recorded described image signal in claim 14. 

[Claim 1 6]A signal processor composition concerning processing which reproduces a recorded 
described image signal in claim 15 being separable if needed. 

[Claim 1 7]A signal processor characterized by the above-mentioned predetermined processing 
being processing which sends out outside a signal which performs processing which relates to a 
described image signal and/or a described image signal at record in claim 1 . 
[Claim 1 8]A signal processor making into a desired thing a relation between a period which 
performs the above-mentioned predetermined processing by having further a delay means which 
delays transfer of a described image signal in claim 1, and setting up appropriately a period of 
delay by the above-mentioned delay means, and a period when a described image signal is 
transmitted. 

[Claim 19]A signal processor, wherein the above-mentioned predetermined processing is started 
from the time or before of transfer being started for a described image signal by having further a 
delay means which delays transfer of a described image signal in claim 1, and setting up 
appropriately a period of delay by the above-mentioned delay means. 

[Claim 20]A signal processor, wherein the above-mentioned predetermined processing is started 
after the time of transfer being started for a described image signal by having further a delay 
means which delays transfer of a described image signal in claim 1, and setting up appropriately a 
period of delay by the above-mentioned delay means. 

[Claim 21]A signal processor which the above— mentioned predetermined processing is 

processing which records a described image signal, and is characterized by including further a 

processor which performs processing which reproduces a memorized picture signal in claim 1. 

[Claim 22]A signal processing method comprising: 

A picture signal generation step which generates a picture signal. 

A biomedical signal generation step which generates a biomedical signal. 

A picture signal processing step which performs predetermined processing to a described image 

signal under conditions set up based on a described image signal and the above-mentioned 

biomedical signal. 


[Translation done.] 
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DETAILED DESCRIPTION 


[Detailed Description of the Invention] 

[0001] 

[Field of the Invention]This invention relates to the signal processor and signal processing 
method which process recording the picture truth concerning the picture concerned in relation 
to the reaction etc. which the person who looked at the picture shows etc. 
[0002] 

[Description of the Prior ArtjAs an imaging device which picturizes a desired picture, various 
things, such as a device which uses CCD (Charge CoupledDervice), for example, are known. 
[0003] 

[Problem(s) to be Solved by the Invention]However, the device which has the function to 
process giving change to the feeling of the person who looked at the picture among the 
picturized picture information, or recording about the impressive thing etc., for example etc. 
selectively is not known until now. 

[0004]Therefore, the purpose of this invention is to provide the signal processor and signal 
processing method which can process giving change to the feeling of those who look at that 
picture, or judging the impressive thing and recording about such picture information among the 
picturized picture information, for example etc. selectively. 
[0005] 

[Means for Solving the Problem]An invention of claim 1 is a signal processor characterized by 
having a picture signal processing means to perform predetermined processing to a picture signal 
under conditions set up based on an output of an image sensor which generates a picture signal, 
a biomedical signal sensor, and a picture signal and a biomedical signal sensor. 
[0006]An invention of claim 22 is a signal processing method characterized by having a picture 
signal processing step which performs predetermined processing to a picture signal under 
conditions set to a picture signal generation step which generates a picture signal, and a 
biomedical signal generation step which generates a biomedical signal based on a picture signal 
and a biomedical signal. 

[0007]According to the above inventions, processing of record etc. is made to a picture signal 
which an image sensor generates under conditions set up based on data in which change of 
feeling, etc. are shown for example, it is detected based on an output of a biomedical signal 
sensor, and a picture signal. 
[0008] 

[Embodiment of the Invention]The composition of one embodiment of this invention is explained 
with reference to drawin g 1 . A human body is equipped with CCDS as an image sensor, and n 
body sensors to 11^, such as temperature sensor 11^ and myoelectric potential sensor llg. 
CCDS changes the entering image pick-up light into an electrical signal, and it supplies an 
electrical signal to A/D converter 9. CCDS is made by equipping **** of glasses, etc., for 
example as [ generate / the picture signal concerning the picture possible nearest to the picture 
which the covering arrival person is actually looking at ]. 

[0009]A/D converter 9 carries out the A/D conversion of the signal supplied. The output of A/D 
converter 9 is supplied to the delay element 15 in the image signal processing part 10 and the 
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storage parts store 14. The image signal processing part 10 generates trigger signal V relevant to 
a picture signal based on the signal supplied, and supplies generated trigger signal V to the 
recording control section 16 in the storage parts store 14. 

[0010]On the other hand, A/D-converter12^ - 12^ are provided in the latter part of each body 
sensor of 11^ - 11^, respectively. A/D-converter12^ - 12^ carry out the A/D conversion of the 
signal supplied to each. The output of A/D-converter12^ - 12^^ is supplied to signal processing 
part 13^ - 13^, respectively. Signal processing part 13^-13^ generate the trigger signal relevant 
to the signal of a body sensor based on the signal supplied. For example, signal processing part 
13^ generates trigger signal T relevant to the output of temperature sensor 11^ which measures 
body temperature etc., and signal processing part 1 generates trigger signal K relevant to the 
output of myoelectric potential sensor 1 1 2. As a body sensor, sound sensors, such as a 
microphone, a heart rate meter, a sphygmomanometer, etc. can be used for others. 
[001 1]The output of signal processing part 13^ - 13^ is supplied to the recording control section 
16. The recording control section 16 generates the signal R which writes in based on trigger 

signal V supplied, T, and K and shows a shelfHife, and supplies the signal R to the record 

circuit 18. The delay element 15 supplies the suitable picture signal which carried out period 
delay and was delayed to the recording format-ized circuit 17, in order that the recording 
format-ized circuit 17 and the record circuit 18 grade may operate the picture signal supplied 
from A/D converter 12 according to instructions of the recording control section 16. The 
recording format-ized circuit 17 changes into the suitable signal forms for processing by the 
record circuit 18 the picture signal supplied from the delay element 15 according to instructions 
of the recording control section 16. The record circuit 18 performs processing for recording the 
output of the recording format-ized circuit 17 on the magnetic disk 19 with reference to the 
signal R which shows the write-in shelf-life supplied from the recording control section 16. It 
may be made to transmit the output of the record circuit 8 to an external recorder etc. 
[0012]In playing desired information from the magnetic disk 19, according to instructions of the 
reproduction control circuit 23, the regenerative circuit 20 reads the data currently recorded 
from the magnetic disk 19. The signal which the regenerative circuit 20 generates is supplied to 
the format conversion circuit 21. The format conversion circuit 21 changes the format of the 
signal supplied into a thing suitable as an output signal. D/A conversion of the output of the 
format conversion circuit 21 is carried out by the D/A conversion circuit 24, and it is outputted 
outside. Operation of the recording control section 16 and the reproduction control part 23 is 
controlled by the main control circuit 22. 

[001 3]A recording medium is not limited to a magnetic disk and can use various recording media, 
such as a recording medium of the tape shape of the recording medium of the shape of a disk, 
such as a phase change type optical disc (PD) and a magneto-optical disc (MO), magnetic tape, 
an optical tape, etc., and a flash memory. 

[0014]It may constitute so that the composition concerning reproduction of the regenerative 
circuit 20, the format conversion circuit 21, and D/A conversion circuit 24 grade can be 
separated. According to such composition, there is an advantage of a covering arrival person 
being able to carry easily a small and lightweight portion including only the component 
concerning record. 

[0015]Next, the image signal processing part 10 is explained in detail. An example of the 
composition of the image signal processing part 10 is shown in drawin g 2. The picture signal 
which is an output of A/D converter 9 is supplied to the frame memory 31 and the subtracter 
32. The output of the frame memory 31 is supplied to the subtracter 32. The subtracter 32 
computes the difference between the picture signals supplied, and supplies the computed 
difference to the absolute value calculation circuit 33. The absolute value calculation circuit 33 
calculates an absolute value about the difference supplied, and supplies the calculated difference 
absolute value to the integrating circuit 34. The integrating circuit 34 integrates the difference 
absolute value supplied over a predetermined frame number, and supplies an integrated value to 
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the comparison circuit 35. 

[001 6]A predeternnined threshold is supplied to the comparison circuit 35, and the signal which 
shows the comparison result of this threshold and integrated value is supplied to the trigger 
generating circuit 36. The trigger generating circuit 36 generates trigger signal V according to the 
signal supplied. Here, the case where an overall luminance level has change when the object 
within a picture moves and CCD8 moves with a covering arrival person as conditions which 
generate trigger signal V etc. are mentioned, and also when It is any, it can judge based on inter- 
frame difference. 

[0017]The composition which generates a trigger signal may be used as the image signal 
processing part 10 by extracting a motion vector by methods, such as block matching, and 
performing processing based on the extracted motion vector. 

[0018]Next, signal processing part 13.| which generates a trigger signal in relation to the output 
of temperature sensor 1 1 ^ is explained in detail. An example of the composition of signal 
processing part 13^ is shown in drawin g 3. The signal with which A/D-converter 12^ comes to 
sample the output of temperature sensor 11^ with a suitable sampling period is supplied to the 
delay element 41 and the subtracter 42. The delay element 41 carries out prescribed period 
delay of the signal supplied, and is supplied to the subtracter 42. The subtracter 42 computes 
the difference between two signals supplied, and supplies the computed difference to the 
absolute value calculation circuit 43. The absolute value calculation circuit 43 calculates an 
absolute value about the difference supplied, and supplies the calculated difference absolute 
value to the comparison circuit 44. 

[001 9]A predetermined threshold is supplied to the comparison circuit 44, and the signal which 
shows the comparison result of this threshold and the output of the absolute value calculation 
circuit 43 is supplied to the trigger generating circuit 45. The trigger generating circuit 45 
generates trigger signal T according to the signal supplied. A trigger signal is generated, when it 
originates in a certain stimulus having been added to the covering arrival person and a covering 
arrival person's body temperature changes with above composition. What is necessary is just to 
set up the period of delay by the delay element 41 suitably, in order to detect change of body 
temperature. 

[0020]Next, signal processing part 132 which generates a trigger signal in relation to the output 
of myoelectric potential sensor is explained in detail. An example of the composition of signal 
processing part ISj is shown in drawin g 4. The output of A/D-converter 122 supplied to the 
absolute value calculation circuit 51. The output of the absolute value calculation circuit 51 is 
supplied to the peak detection circuit 52. The peak detection circuit 52 detects a peak value 
from the signal supplied, and supplies the detected peak value to the comparison circuit 53. 
Here, a reset signal is supplied to the peak detection circuit 52 with a fixed time interval. 
[0021] Whenever a reset signal is supplied, the peak value which the peak detection circuit 52 
detected before it is reset. Thus, a peak is detected for every fixed time interval. A 
predetermined threshold is supplied to the comparison circuit 53. and the signal which shows the 
comparison result of this threshold and the output of the peak detection circuit 52 is supplied to 
the trigger generating circuit 54. The trigger generating circuit 45 generates trigger signal K 
according to the signal supplied. Thus, the propriety of generation of trigger signal K is 
determined for every fixed time interval. 

[0022]A trigger signal is generated, when it originates in operation of the stimulus and covering 
arrival person who joins a covering arrival person etc. and myoelectric potential changes with 
above composition a lot above to some extent. For example, if the muscles of a face are 
equipped with a myoelectric potential sensor, a trigger signal will be generated based on change 
of expression. The composition which generates a trigger signal may be used as the image signal 
processing part 1 0 by performing processing based on the difference of the pulse (peak) interval 
of myoelectric potential. 

[0023]Next, the record control circuit 1 6 is explained in detail. As mentioned above, the record 
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control circuit 16 makes a synthetic judgment based on each trigger signal generated by signal 
processing part 13^ - 13^, and generates the signal R which shows a write-in shelf-life. An 
example of the composition of the record control circuit 1 6 is shown in drawin g 5. Here, the case 
where 3 kinds of trigger signal V mentioned above as a trigger signal. T, and K are supplied is 
shown. Trigger signal V, T, and K are supplied to AND circuit 61. AND circuit 61 supplies the 
AND signal which generated and generated the AND signal based on trigger signal V, T, and K to 
the waveform shaping circuit 62. The waveform shaping circuit 62 performs waveform-shaping 
processing of removal of an isolated point, etc. to the signal supplied. The output of the 
waveform shaping circuit 62 is supplied to the synchronous circuit 63. 
[0024] On the other hand, the control circuit 64 generates the signal which starts 
synchronization information according to instructions of the main control part 22, and supplies 
the generated signal to the synchronous circuit 63. The synchronous circuit 63 performs 
processing which takes the synchronization according to instructions of the main control part 22 
to the signal which the waveform shaping circuit 62 outputs. As a result of such processing, the 
signal R which shows a write-in shelf-life is outputted from the synchronous circuit 63. Also in 
the case where the kind of trigger signal is except three kinds when a trigger signal contains 
things other than V, T, and K etc., The signal R which writes in by changing the kind and the 
number of a trigger signal which are supplied to AND circuit 61 in composition which was 
mentioned above, and shows a shelf-life is generable. It may be made to use only the thing of 
the request of two or more trigger signals for processing by the recording control section 16 by 
composition of forming a switch in the preceding paragraph of the recording control section 1 6. 
[0025]An example of the timing chart concerning overall operation is shown in drawing 6 . Drawing 
6_A shows time progress. Here, S shows a period with a significant stimulus. As the period S is 
explained below, it is detected. To the timing shown in drawing 6 B, a picture signal is supplied to 
the memory storage 14. To the timing shown in drawing 6 C, trigger signal V relevant to a picture 
signal is generated. Here, since trigger signal V is generated when the object within a picture 
moves as mentioned above, within the period when a series of picture signals shown in drawing 6 
B are supplied, the standup/falling of trigger signal V arise. Except that a picture signal is 
supplied, also in a period, it originates in a noise etc., and trigger signal V may be generated. 
[0026]To the timing shown in drawing 6 D. trigger signal T relevant to the output of temperature 
sensor 1 1 ^ which measures body temperature etc. is generated. Here, it is thought that change 
of the body temperature resulting from gazing, for example at a picture is reflected. To the 
timing shown in drawing 6 E, trigger signal K relevant to the output of myoelectric potential 
sensor llg is generated. This trigger signal K is generated by pulse form when the peak value of 
the myoelectric potential within a fixed period turns into more than a threshold, as mentioned 
above. Within the period when a series of picture signals shown in drawing 6 B are supplied, the 
standup/falling of trigger signal K arise. Except that a picture signal is supplied, also in a period, 
it originates in a noise etc., and trigger signal K is generated and trigger signal T relevant to the 
output of temperature sensor 1 1 ^ which measures body temperature etc. has a generation 
tsfnj!***** case. 

[0027]It seems that the and output of drawin g 6 C, drawing 6 D, trigger signal V shown in drawin g 
6_E, respectively, T, and K, i.e., the output of AND circuit 61, is shown in drawing 6 F. And the 
write-in shelf-life signal R is generated so that it may rise over predetermined recording periods 
from the standup time U of the beginning of an and output (refer to drawing 6 G). Actual 
recording processing is started from the time of being delayed from the standup point in time of 
the write-in shelf-life signal R by the time delay resulting from operation of composition of 
starting recording processing, etc. It becomes recordable [ recording the picture signal before U 
the time of an and output rising first etc. ] to desired timing by changing the period of delay by 
the delay element 1 5 in drawing 1 . 

[0028]Various modification and application are possible for this invention within limits which are 
not limited to one embodiment of this invention mentioned above, and do not deviate from the 
main point of this invention. 
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[0029] 

[Effect of the Invention]According to this invention, processing of the record over the picture 
signal which an image sensor generates, etc. is performed under the conditions set up based on 
the data in which it is detected based on the output of a biomedical signal sensor, for example, 
change etc. of the feeling of the person who looked at the picture are shown, and a picture 
signal. 

[0030] For this reason, it can process recording selectively about the thing concerning the 
picture which made the feeling of the person who saw produce change among the picture signals 
which an image sensor generates, the picture which gave the deep impression to the person who 
saw, etc. 


[Translation done.] 
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DESCRIPTION OF DRAWINGS 


[Brief Description of the Drawings] 

[Drawing lilt is a blocl< diaeram showing an 

embodiment of this invention. 

[Drawing 2]It is a blocl< diagram showing an t 

embodiment of this invention. 

[Drawing^It is a block diagram showing an ( 

embodiments of this invention. 

[Drawing 4llt is a blocl< diagram for explainin 

further others of this invention. 

[Drawing 5]It is a block diagram for explainin 

that of one embodiment of this invention. 

[Drawing 6]It is a timing chart which shows a 

embodiment of this invention. 

[Description of Notations] 

8 [ ... A myoelectric potential sensor 16 / ... 

signal processing part, 1 1 ^ ... A temperature 

ixample of the overall composition of one 
ixample of the composiUon of a part of one 
ixample of the composition of a part of other one 
; the composition of a part of one embodiment of 
I the composition of the part of further others from 
n example of the operation timing in one 

Recording control section ] ... CCD, 10 ... An image 
sensor, 1 1 g 

[Translation done.] 
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